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This panel's go^l was to develop the means to improve 
teachers' ability to perform general a3d specific ^skills of teaching 
within curriculum areas and stud^ent developinent ld*vels. The panel 
ftjcused.oi} research to improve teacl\er performance of instructional 
skills and identified two basic a'pproaches to this researfch. The 
first approach dealt with the identification of important teaching 
sfccills by (1) utilizing statements drawn from .psychological, 
developmental, and pedagogical theories, as well as theories of 
subject mattdr;^ (2) analyzing' observed t4'acher practice into skill 
components and sjiowing the relation of these components to- 
educational outcomes,; and (3) utilizing reports of teachers and other 
persons concerning what ihey believed to b'e important teaching 
skills; The second approach dealt with the identification of training 
and validation procedures which demonstrate how teaching* skills are 
related to educational outcomes* This approach looked at (1) the 
transferability of skills, (2) the school cbnditions needed to 
optimize maintenance of i.mportant skills, (3) the development of 
measures to define the effectiveness of teaching skills, and (4) the 
relationship of skills possessed by individual teacher to 
educational outcomes. The panel identified spetific programs of 
research and development related to each approach. Each program 
included descriptions of the criteria fo;: judging the relevance of 
research projects within the program, v,(BD) 
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PREFACE 



* The vcflum^ before you is the report of one of ten panels that parti- 
cipated in a five-day conference in i/ashington during the summer of 1974, 
The primary objective of this Conference was to provide an agonda for 
further research and developmenj: to guide the Institute in its planning 
and funding oyer the next several -years. Both by the -involvement of some 
100 respected pr^actitioners, administrators, and researchers as panelists, 
and by the public debate and criticism of the panel reports, the Institute 
aims to create a major role for the practitioner and research comnunities 
in determining the-direction of government funding. 

The Conference -itself is*seen as only ah event in th6 middle of the 
process. In many months of preparation for the Conference, the staff met 
with a num^ber of groups— s^tudents, teachers, administrators, etc-— to 
develop coherent problem statements which served as a charge to the panel- 
istSi Panel chairmen arid others met b6th before and after the Conference. 
Several other panelists were commissioned to pull together the major 
themes and recommendations that Ijept recurring in different panels (being 
reported in a separate Conference Summary Report): Reports are being 
distributed to practitioner and research coimiunities. The Institute 
encourages, other interest groups to debate and critique reHevant panel 
reports from their own perspectives-. 

. The Conference rationale stems -from the frank acknowledoment that 
much of the>funding for educaticmal research and development^projects 
has not been Coordinated antj sequenced in such a way as to avoid undue 
duplication yet fill significant gaps, or in such a way^as to bifild a 
cumulative impact relevant to educational practice. Hor have an agency's 
affected constituencies ordinarily had the opportunity, for public dis- 
cussion of funding alternatives d:ncl proposed directions prior to the 
actual allocation of funds. The Conference is thus seen as the first 
major Federal effort to develop a cooHinated research effort in the 
social sciences, the only^ comparable efforts being the National Cancer 
',Plan and the National Heart and Lung Institute Plan, which served as 
models for the present Conference. 

, As one of the Conference panels, points out, education ^'n the United 
States IS moving toward change, whether we, do anything about it or not , 
The outcomes of sound research and development— though enlisting only 
a minute protion of the education dollar— provide the leverage by 
which'such change can be afforded coherent direction. 
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In implementing these notions for the area of. teaching, the Conference 
panels were organized around the major points in tt)% career Of a teacher: 
the teacher's recriritment Awd selection -(ohe panel), training (five 
panels), and utilization. (one panel ). In addition, a panel was' formed 
ta "examine the role of the. teacher in new instructional]' system§. ^Finally'^ 
'there were two panels dealing with -research methodology and theory - 
development. ^ \ ' • 



education a i practi c e 



teaching as 
human interaction 



teaching 
behavi or 




as 

analysi s 



performance 



teach^ing as 
a 1 i ngu i sti c 



process 



teaching as 
cl inical informdition 
proces-s-ing . 



training & performance 




piahning & 
research 



personnel rol es| 
. i n new sys tems 



research 
methodology 



theory 
deve,l opment 



Within its specific problem area, each panel refined its goal stater 
ment, outlined several " approaches " -or overall strategies, identified 
potential " programs " within each approach, e^nd sketched out* illustrative 
projects so far as this was appropriate and feasible^. 

Since the brunt of this work was done in concentrated sessions in 
the'space of a few days, the ^esulting documents are not polished, inter-, 
nally consistent, or exhaustive. .They are working papers, and their pub- 
lication is intended to stimulate' debate and refinement. The full list 
of panel reports is given on the following page. We expect serious and 
concerned readers of the reports to (j^ive suggestions and comments. Such 
conigents, or requests for othen panel reports, ^^hould be directed to: 

^ , Assistant Director, " ' . 

Program on Teaching and Curriculum " 
National Institute of Education 
' 1200 19th Street, N. W. 
Washington, Di C. 20208 

J- 
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As the organizer and overall chairman for the Conference and editor 
for this series of reports, Professor L. Gage of Stanford Universjty ^ 
richl^j deserves the appreciation of those in the field of teaching research 
and development. The panel chairpersons^ singly and together, ^Jid remarlT- 
able jobs with the ambiti^s char^ placed before thern. Specialr.acknowT- 
eJtgments are due to Philip. Winne of Stanford University and to Arthur- 
Young & Company fSr coordination and arrangements before, du^ing, and 
after the Conference. But in sum toto, ^ it is the exper^t parlelts-ts— 
each of whom made unique contrtbufions in his or her resp&tive a)^ea— 
who must be given credit for making the Conference productive up to \ 
^the presentostage. It is now up to the reader to carry through the ' 
refinement that the panel ists have placed in your hands\ , • ^ 

. * . . Garry L. McDani^l§ 

. Program on \6ach-iiig and Curriculum 
' ^ . ' f " 
LIST OF PANEL REPORTS 'AND CHAIRPERSONS . - ^ 

1- Teacher Recruitment^ Selection, and Retention , Dr. Jafries Deneen, 
Educational Testing Service 

2. Teaching as Human Interaction , Dr. Ned A\ Flanders, Far West 
.Laboratory for -Educational Research and Development , • 

3. Teaching as Behavior Analysis , Dr., Don Bushel 1, Jr., University 
of • Kansas - * ' 

4. ' Teaching as Skill Performance , Dr. Richard Turner, Indiana 

University. . - , , . 

5. Teaching as a* Linguistic Process in a Cultural Setting , , 

Dr. Courtn'ey Cazden, Harv.ard- University \ \' , ^ 

6. Teaching as Clinical Information Processing , Dr. Lee S. Shulman, ' 
^ Michigan State University- - , ^ . 

7. Instructional Personnel Utilization , Dean Robert Egbert, 
" University of Nebraska . ' . 

8. Personnel Roles in New Instructional Systems , Dr. 'Susan Meyer Markle, 
University of Illinois . , 

9. Research 'Methodology , Dr. Andrew Porter, Michigan State University^* 

-I ^ ' ■ 

10. Theory Development , Dr. Richard Snow, Stanford University 

• Conference on Studies in Teaching: Summary Report , 
* Dr. N. L. Ga-ge, Stanford University ^ 
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■ INTRODUCTION 

Backghound ,and Method Used, to Produce the Recommendations 

Panel 4 focused on research to improve teacher perfonfTance of 
skills. Two basic approaches to this research were identified. The 
first deals with the identificati'on of important tea?:hing*skills^ the 
secpnd with training and validation procedures which clemonstrate how 
the^ski'-lls are' related to educational outcomes. . * • . 

<• 

Three ways of identifying teaching skills were developed.^ The 
.first utilizes theoretical statements drawn from psychological, develop- 
mental and pedagogical '^tliegries,. as well as theories of subject matter 
instruction, ^s the- basic sources. These statements are to be reduced 
to operational definitions of cl.usters of skills, and these skills 
are subsequently identified in teacher behavior^'. Thj^s approach to skill 
definition 1§, "open" ana permits* the iatroduction of-^new ^ets"" of skills 
^s new ways of viewitig education emerge. The s.econd methocj fof" skill ' ' 
identification depends on analyzing observed teacher practice into 
skill components and Showing empirically the relation of these components 
to educatiolial outcomes. This method is intended to reveal the s'y^nifi- 
cant skills in current teaching practice. The third method for identifying 
skills uses reports of teachers and other persons concerning what they 
Beli^eve to be important teaching skills. This method identifies skills ^ * 
<that are believed tp be ilpportant in the practical condUct of teaching. 
None of these three methods stands completely alone as the method for' ^ ^ . 
identifying skil]s; rather they^ ar^e complementary and should be made . " 
to converge so as .to^pro^fuce a'Comrtion core of highly salient skill's. " , 

Research on training for and'validating teacher skill s is aimed 
at^the complex problems of finding the best proqedur^s for^train^ng 
.teachers in their professional skills and'of identifying the e)(act 
dircumstances under which exercise of a particular skrll vfil'l have, 
optimum impact.. Subordinate problems within this kind of research 
include determination *of the transferability of skills aSfthe ciV'- \ . ^ 
cumstances surrounding, teaching change, and identification of the 
conditions needed iif schools to optimize maintenance* of important , - 

teaching skills and hence to prevent teachers from slipping into 
"bad practice". Certain theoretical problems are also identified 
as intrinsic to this line of^ research. The fjrst deals with the 
metrics by which the elasticity, or variability in the effectiveness of 



nie conference on studies in teaching 



i 



f 



teaching skills can be definedi the second, with the repertoire of 
skills possessed, by individual teachers and the relationship of this 
repertoire, 'as a'seti coeducational outcomes. • , , 

}/ Jh'e format used by the Panel fdv eUhorating. the two general 

Approaches described above was ^o identify specific programs of 
- .research relatM to ^ach Approach. Included in the program descrip- 
tions are criteria for j^idging €he rele(rance of research projects 
related to'tjie program.; subsequently, illustrative pfV^ojects are 
, briefly described to.,cJ^rifit«what t.he Panel intended by its state- ' 
^ m^nts, about the program.- These projects are not proposed to beC 
funded, but onl^-to;.i^-llistrate a class of projects to be developed 
in jthe field and'^submitted fofV^view and, possible funding. 



Organization of the Report 

The description of the Panel* work begins 
and discussion of. the Panel* s goaV'for research 
perforinance, fallowed by an overv.ievf *of t^e cons 
the Panel ultimately arf*ived at the research App 
above. Next is^ presented the decision-making st 
Panel found -useful in fra[fiing*1tSw thinking about 
and projects. ^ ^ « . , 

- The remainder of , the report presents, witffi 
Approaches in turn, the recommended programs and 
pertaining to the Panel's goal area. 



with 'a presentation' 
on teac|iing as skill 
ideration§^y which 
roaches mentioned 
ructure which the 
specific programs 



n each of the two- ' 
illustrative projects 



Panel Goal Statement > - . . 

The PaneTs goal was to 'develop the means to imppove*teachers' 
ability to perform general and specific skills of teaching within* 
curriculum areas and student developmental. levels. ' 

. _/First the Panel examined alternative approaches to^ the definition 
of general and specific teaching skills. AJ^though several issues were 
presented and discussed, no formal definition was made by the Panel. 
The following aspects of teaching skills were accepted, however, *as u 
working characterization of the term 'skill*: . - 

0"* Teaching skills exist in. a variety of "teacher 

roles, e.g., in relationships with^ school priiici- ^ 
jjals, or parents, as well as with studinjbs. ' ^ 

0 Teaching skills have consequences. A logicalt chann 
connects a specific skilj^with its consequences. ' 
TJi^ consequences can be both targeted {or dfrect) ^ 
and peripheral (or indirect)^ 



0 



1 

0 



Operationally; teaching skills are ttTne-bound ia'the 
sense that the outcomes or consequences of a skill 
must be observable withinr a reasonable periojd, e.g., 
a*school year. , . ' - . . 
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, 0 . • Specific teacbing skilj.s may be distinguished from > 
skillful ness . The latter includes-: (a) determining [ 
- -What Is to be done, (b) asking whether a particular 

skill achieves the desired effect^ and (c) timing 
^ the use of a siJec.ific skill to achieve the effect. 

0 Specific teachilig skills can be rated for quality. • 

p , Normative criteria have been established for the. 
performance of certain tea^ching methods whicb , 
incorporate specific skills. ' 

•0^ • Teaching skills are moderated by the context or 
situation in which they are performed. 

.0 A skijl has- air intentional or purposive aspect; 
i.e. , - ^- - - - - 

skill. 



i.e., there is a reason for performing a particular 



0 Skills of special interest to the panel are those- 
Which are trainable, but a second group of untrain- 
^ able or^diff.icult^to'^train skills (or "aptitudes") 
is recognized. - * • 

'De rivation of Approaches and Programs * • 

Exhibit,! lists the Approaches, ^rui programs which were proposed, 
to the Panel in the preliminary materials, along with several progV^ams 
proposQjJ'^n early sessions of the Panel. The following discussion of 
the .interrelations of these three Approaches .documents some of the^ 
Panel's initial consifleration, leading eventually to the combining of • 
Approaches 4.2 and 4.3Jnto a single approach. , ' 



cer 



Identifying Teaching 'Skills (Approach 4;i) : This Approach. is^con- 
ned with identifying teaching •skill s related to learner outcinnes. 
Studies jn this area would usually employ observational and analytic 
techniquesnn whjch the elements Cx^bservatton categories, ornits..of anal- 
ysis) are derived from theory. Th'ese, elements are then used in inservice 
field settings to identify and further define promising' teaching skills. . 
Correlational research is typically used to establish relationships 
between the designated learner outcomes and the skills , identified-^ 
This Approach^ answer^ the questions "What specific teaching behaviors, 
skills and strategies are related to designated laarner outcomes?" 

Skill Training (Approach 4.2) : Those skills identified in 
^^Approach 4.1 form the point of departure for proposed Appr6ach»4.2, 
which is concerned with developing the meansHo train teachers in these 
skills. Approach 4.2 would use a lygorous development sequence to build 
the necessary traijiing coh)ponents. This strategy generally involves 
the following steps: 

1. Develop a prototype training component designed to train 
teachers to use the specific behaviors identified at an"" 
acceptable skill level 
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EXHIBIT I Initially Proposed Approaches and Possible Programs 

Approach 4 J : Examine alterneftive approaches to the definition and 
identification of general and special teaching skills* 

0 Examine facet theory as a tdchniqua for identifying skill's* 

\ 0 Examine learning theories (behavioral, cognitive, 

information processing) as bases for identifying sl^ills* 

0 Examine curriculum and developmentaK theories as 
bases for identifying skills. ' 

0 - Examine theories of education as a means of deriving 

skills. ' ^ \ 

h \ 

0 Natural Variability Strand: Examine teacheVs' skills 
or strategies of skills as they relate to differences 
in achievement levels of students in order to determine 
the skills or streitegies which affect those differences. 

0 E}jamine needs assessmeht and other expert opinion as 
a.nieans of identifying skills. 

0 Determine how the subject matter competency of teachers 
relates to teaching skills within a subject mattr*\ 

Approach 4*2 : Examine and develop means to improve the degree to 
which teachers perform general and specific skiJls. 

0 Develop me.thods of n^asuring the degree to which teachers 
can and will perform skills. 

0 Develop efficient means to train teachers In general and 
speciial. skills. 

0 Determine the personal and envirqfnmental factors that 
lead to improvement or deterioration of teacher skills 
' and apply t{)is knowledge to facilitate skill improvement 
and avoid 'skill deterioration. 

Approach 4.3 : Determine the effects of various general and special 
skills on student achievement of educational objec- 
tives (cognitive, -social -emotiona^l.^ psychomotojJ ._ 

0 Develop and apply techniques for efficient validation 
of skills in terms of effects on outcomes in student . 
behavior during the teaching-learning process.' 

0 Develop and apply techniques for efficient' validation 
of skills in terms of effects on outcomes in student 
achievement, retention, and transfer. 
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2. -.F^eljJ test tKe prototype, collecting formative evaluation 

cla>ta . 

3, Revise the prototypes as indicated by the evaluation i1^ 
teachers do not reach criterion on the trained skills. 

This sequence would be repeated until a training component was 
developed that met the developer's criteria in terms of both quantity 
and quality of teacher performance. It is possible that correlational 
studies' will yield^some skills- that, for-all pr^actical purposes, are 
no t_ trainable. These skills.^would, of course, be revealed in' the 
research 5 nd.djEtstelopment activities carried out under this Approach. 

The training strategies developed under Approacji 4.2 wouTd also 
produce a high level" of teacher variability in certain skills which, 
in turn, wou.ld make it possible to study these skills in proposed , 
Approach 4.3, the Validation Approach. This is particularly important 
for newly discovered' teaching skills that occur very rarely in the 
repertoire of practicing teachers. 

Seve>:al limitations apply to proposed Approach 4.2 in this form. 
The Panel y/ould not propose that training irfaterials or strategies be 
carried jthroiTgh the entire R&D. sequence >that is applied to commercially 
distributed pro^iucts such as have been developed at the regional labora 
^ tories. By imposing the following limitations^ a great deal of. fim^e 
and money ca?i be saved: • , ' 

1. Materials^ etc. , would be developed to the point that they 
can be used in experimental research but nojt to the point 
where they are ready for widespread use in pre-service or . 
in-service teacher education. This is an important limita- 

, tion, since the final revisions and national field tests 
needed to ready materials or processes for national use are 
very costly. 

2. No dissemination effort would be carried out. Dissemination 
is extremely costly. However, the main reason that no dissem- 
ination would be funded is that, at this point, no cause-and- 
effect relatiotiship has been established between teaching 
skills as trained by the 4.2 materials and learner outcomes. 

A further limitation to Approach 4.2, studies as proposed is that 
such studies should not be funded unless definite plans have been made 
to employ the 4.2 materials in an experimental validation study. A 
weakness^_in_^niost^ - - 

develop teacher training materials and test their effectiveness in 
changing teacher behavior, but were n6t provided to determine whether 
teacher use of the trained stills^ caused desjred changes in learner 
outcomes.^ Correlavional studies such as proposed for Approach 4. T 
cannot establish thJs cause-andreffect relationship. 

Validating Skills by Determining the Effects on Learning Outcomes 
(Approach 4.3) : Once materials and strategies that will develop -a 
desired set of teacher skills were built in Approach 4.2. these could 
be used as independent variables in studies funded under Approach 4.3. 
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studies funded under 4.3 would normally employ experimental designs 
with pre-post measurement of both teacher skills and learner outcomes. 
There are, however, other designs and strategies that might be used in 
Approach 4,3. The investigator should not be confined to classical 
experimental designs. 

In funding studies under Approach 4,3 it would be suggested by 
the Panel that small-scale experimental studies which employ in-depth 
data collection with samples of 20-50 teachers, plus their students, 
will.be more cost-effectiv^ than large-scale studies. Such studies 
can be completed more rapidly and a»^e also low enough in cost to permit 
replication to check important results. Studies, of this magnitude are 
<|also within the capabilities of small research teams. Thus, a broader 
sample of available researchers could be employed, in the program. The 
main limitation of small-scale studies is that the investigator's anal- 
ysis must deal with relatively few variables. In studies that seek to 
consider a wide variety of skills, larger samples will be needed. 

The Combining of Approaches *4,2 and 4.3 into a Single Approach 4.2 : 
The previous discussion has pointed out the proviso that teacner train- 
ing studies (Approach 4.2) should not ordinarily be carried out without 
some plans for validating such training against learner outcomes (Approach 
4-.3). Furthermore, while It is easy enough to distinguish between 
teacher training and classroom teaching, some of the prime research 
questions in these two' areas are closely related, and it sometimes 
becomes academic to try to distinguish whether a particular, research 
question is aimed more at improyjjog. the effectiveness of teacher skill 
performance or at improving the effects of such performance gn learner 
outcomes. ^ — - - \ „ 

In view of these considerations, the Panel decided io incorporate 
the concerns of Approaches 4.2 and 4.3 into a single Approach, thus 
allowtng a somewhat different framing of the programs within this 
Approach. The Approaches and programs as finally adopted are shown 
in Exhibit II; the reader may judge for himself the appropriateness of 
the resulting organization. 

Other Possible Approaches : The Panel considered other possible 
Approaches. It was acknowledged that the question of subject-matter 
competency was an important area of concern, not only in' terms of 
knowledge in a particular field but also, in terms of the appropriate- 
ness of different teaching procedures and techniques as a function of 
the subject matter and the developmental 16ve1. Rather than Isolating 
this question to a single Approaph, however, the Panel felt that it 
_^was-.proper4^y.^an important concern for each program 1n each Approach. 

Another proposed Approach dealt-with the teacher's skill repertoire, 
to include such facets as clusters of skills, sequences of skills, and 
strategies of teaching...' This took final shape as Program 4.2.6 under 
Approach 4.2. 

Finally, the. Panel considered another Approach dealtng with the 
final development and dissemination of training materials and strategies 
which had been proven effective in the Approach 4.2 validation. How- 
ever, the Panel concluded that these steps are costly and might better 
be allocated to funding agencies other than NfE. 
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EXHIBIT II Adopted Approaches and Programs 

Approach 4.1 : Examine alternative approaches to the definition and 
identification of general and special teaching skills. 

Program 4.1.1 : Develop and apply a conceptual -analytic method for 
identifying hypotheses about effective skills. 

^Py-ogram 4.1.2: Examine teacher's skills and strategies as they relate 
to differences in achievement levels of students in 
orJer to determine the skills or s-trategies which 
affect those differences. 

Program^4J.3 : Examine needs assessment and other expert opinion as 
• a means of identifying skills. 

Approach 4.2 : Examine alternative approaches to the training and 
validation of general and specific teaching skills. 

Program 4.2.1 : Examine changes in the effectiveness of skills caused 
by differences in pupil characteristics, including the 
determination of the smallest effective stimulus for 
eliciting a pupil response and the appropriate metrics 
for measuring skills. 

Program 4.2.2: Determine which training strategies effectively produce 
. acquisition of a skill at each of its levels, using 
variation in training as the independent variable and 
lAveJ_i)f^kiJJ„ac^^ as the dependent variable. 

Prggram 4.2.3 : Determine the conditions which affect skilT maintenance, 
e.g., age, sex, and class of students and socio-political 
context. 

Program 4.2.4 : . Consider the transferability of skills, i.e., determine^ 
. 'the level at which a skill is performed in Context B 
when it has been trained in Context A. ' ; 

Program 4.2.5 : Examino the validity of teaching skil Is-as-tra^ined, in- 
cluding (a) the contribution of a skill-as-trained to 
the matrix of student outcomes, (b) the methodological 
problems in identifying the outcomes attributable to \ 
specific skills, (c) the identification of the dimensions, 
principal components, or facets of 'teaching skills-as- 
trained relative to the matrix of student outcomes.. 

Program 4.2.6: Examine the repertoire of skills, including: (a) the 
scope of effective skills, (b) th6 organization of 
skills, (c| the effects of clusters or subsets of skills 
in relation to student outcomes, and Tff)tfie relation of 
skills to traits or aptitudes. 
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THEORETICAL FRAMEWORK: A DECISION-MAKING * 
ANALYSIS FOR AN R&D STRATEGY 

This section presents a structure of decisions tfiat can be made 
about specific projects involving teaching skiVls. The problem to 
which it is addressed is that of how a funding agency sTiould select 
from among proposals tnade to it so that the R&D strategy, will have a 
coherent structure. The structure proposed here is designed to 
achieve this goal specifically for the programs and projects of Panel 
Its general izability to other approaches of other panels has not been 
tested. . 0 

As a structure it hasgeneral criteria built into it, and the 
assumptions underlying these criteria are spelled out below. ^ 

A^cumpt4ons-abou4^esearxh Prog»^ams_ . , 



We assume that research on teaching skills should have practical 
value. Teachers will be trained to use validated skills and will be ^ 
trained by using the strategies found to be most effective. The 
research program, therefore, must be accepted by the cofnmunities of 
its potential u.sers as well as by the research commiiliity. Both kinds 
of acceptance may be difficult to achieve simultaneously because the 
different communities have different criteria for accepting a research 
program. Teachers, for example, are concerned about both the charac- 
teristics of the teaching skills and pupil behaviors which are the 
outcomes of these skills. Researchers are concerned that the research 
.produce scientific knowledge and^that the program ,%1'low for new 
approaches and ideas. Such criteria are not necessarily incompatible, 
particularly if the .program as a whole represents a balance between 
applications of these criteria 'n selecting projects for funding. 

We assume that a project must always ^have poteljitial for yielding 
scientific knowledge, and that one ought not to^sacjrlf Ice such high 
potential simply to gain acceptability in other Cooinunitie?.. But a 
research program which is meant to-^hav^practical ^ppl Ications must 
find a way of insuring that the projects "make sense'^ to the coinmunity 
of potential users. 



I ■ . 
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Two probabilities need to be estimated for each project: 

Pp = probability of its results being accepted and used. 

Pg = the probability that the project will have scientific value. 

The goal of decision making is to optimize these probabilities for 
a single project insofar as possible and for a set of accumulated 
projects withiji a research prog»:^m* 



Assumptions aBbut Pupil Outcomes ^ 

We assume that the degree to which parents, representatives, . 
teachers, and administrators influence the priorities in selecting 
pup.il outconies as dtpendent variables will be directly related to the' 
acceptability of a project and the potential use of thi results by 
such persons. Research aimed at determining the antececlents of outcomes 
^which are valued by these groups will "make sense" to tfl^se groups. 

We assume that researchers are relatively neutral about the 
public and social significance of their choice of outcomes. The 
researcher is interested in causal connections;, /he needs to find a 
network of these to build theories. If he also has strong convictions 
about the social significance of effects on pupils based upon beliefs 
about what kind of society or educational system is desirdbl^, he Is 
acting more as a citizen whose views have sources 6f validityxexternal 
to bis line of research activity. 

The researcher Is free to be neutrcj; the non-research public 
in fact is not. The decision-maker balances these two interests in 
order to maximize support for a research program. ' — — 



Assumptions about Teaching Skills ^ , • 

Some writers hold that the researcher ought to have complete 
autonomy in selecting' his or her antecedent variables. Knowledge of 
theory, experience, and intention play a large role in the choice of 
such antecedents, and the researcher is better equipped to make such 
choices. ' 

But others, such as teachers, are close to the phenomena being 
studied and may provide insights and a sense of realism. They can play 
a useful role in conceptualizing the domain of antecedent variables 
arxd provide useful ideas about antecedents likely to be linked to out- 
comes. 

Teachers also have a stake in how the yield of research on teaching 
is used, and they have priorities about problems. Teachers are sensi- 
tive to the relation of teaching performance to the* context in which 
it occurs. For these reasons the factors of acceptability arid use 
must be considered. 
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The Decision-Making Structare; A Matrix fo»^ Optimizing Selection 
of Projects ~ 

Exhibit III lays out the structure of information needed to make 
decisions that optimize support, use, and^ scientific payoff in a pro- 
gram of research. Not every project must completely optimize these , 
factors. But the set of projects a,s a whole should. Thus, the 
decision maker is left with the problem of weighting choices afe each 
step. No such set of weights is 'here proposed, but they should be 
developed and be made^ublic. 

The matrix shown in Exhibit III has four dimensions. 'Each of 
these dimensions represents a continuum whichj for purposes of 
display, is shown as a dichotomy in. the* exhibit. Dimension 1 deals 
with the degree to which the antecedents to-the research (independent 
and dependeixt variables) represent public school inputs' and accepta- 
bili1;y as opposed to researcher or scientific inputs. Dimension 2 
represents the ease or difficulty of, measuring the dependent and 
independent variables proposed in the prefect. This dimension is 
related to Dimension 1 in that the value assigned to particular vari- 
ables by public school persons or researchers may be moderated by how 
easy or difficult these variables are to measure. Dimension 3 repre- , 
sents a central feature, of i the research design of the project-^^at, one ^' 
extreme (univariate) only one teacher training procedure or orje. ' \ ' ^ 

teacher slall and/^or one pupil outcome variable would be invojve^;; at ^ 
the otheir extreme multiple skills and multiple pupil outcomes' wouldi 
characterize the design. Again, this dimension is related to Dimensions 
T and 2. For example, a researcher may be attrac'ted to univariate / / 
designs with easy-to-measure variables of his own choosjng since he ' 
can optimize control of experimental error in such desi^gns.^ Nonetheless, * 
studies of this kind might be seen as having less practical value in ' 

the ^ yes of public school persons. Dimension 4 (represented within 

each of the cells ot the matrix J| directly addresses the question of V~ 
research payoff. In this dimension, the decision rnaker must, assign, | 
probabilities to both the potential acceptance and use of the project 
outcomes and to their potential for contributing to scientific knowl- 
edge, v • ' / 

It should be noted here that we assume the usual criteria for 
evaluating the specific proposal will be^applied. A poorly designed 
experiment should be rejected; ill -conceived hypotheses^ought not to 
be tested. If the.usua* criteria are applied, then hypothesis testing 
has greater iminediate potential over work which is in one of the other 
phases. Thus, the vertical structure of the matrix infornis the fund- 
ing agency about the pattern of its proposals and raises questions 
about the proper balance among such projects. j 

An appropriate way to use the matrix is to analyze the proposal 
by identifying in which box at each step the proposal falls. At two 
significant phases the structure provides a schema of information, 
about the involvement of different conmurtities of concern and interest. 
It also' provides a schema for checking the stage of development of tfce 
antecedent variables and their sources and of, the development of the \ 
outcome measures. 
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k*hat This Stmcturg Does Not Do - This structure does not provide 
the weights to be assigned to the elements of the structure, or the 
d^jsion rules. If this concept of a structure is appealing, such 
promems cait be addressed. 

Not included also are the specific variables that might or shquld 
appear in the research program. Peer review processes Will help make' 
decisior\s about these choices. Although the structure does ppint to ' 
the relevant choice points in these matters, it does not set goals; 
it assumes them. It does not resolve methodological or theoretical 
issues. It»simply points to choices. to be made and raises the question 
of what criteria ought to be applied in.making these choices/ The 
Panel used the matrix to bring out choices, problems, and issues in 
conceptualizing. It was usefiil for thi^ purpose. Others may find it 
similarly useful . - _ ^ ■ 
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APPROACH 4.1 

EXAMINE ALTERNATIVE APPROACHES TO THE DEFINITION AND 
IDENTIFICATION OF GENERAL AND SPECIAL TEACHING SKILLS 



In the above discussion of the Derivation of Approaches and Pro- 
grams, the Panel documented its assumption that resear*ch Id the 
identification of teaching skills is a three-phase process Including 
(a) the generation of hypotheses, (b) the development of training 
based on the hypothesized skills, and (c) the validation in terms of 
student outcomes. The latter tHo phases have been incorporated together 
in Approach 4.2; The Panel wants to emphasize that the programs, and- 
projects suggested under Approach* 4.1 constitute only the first phase, 
and would still be subject to the training development and validation 
phases covered in Approach ,4.2. 

In focussing on the identification of teachi^ng skill s,jthe Panel . 
identified three alternative methods, which are- covered respectively 
in the three programs outlined'under this Approach. The first of these, 
is the conceptual-analytic method, which would use. constructs drawn 
from educational theory, from patterns of school organization, or frpin 
curricular frameworks as a springboard for identifying teacher skills 
presumably correlated with learned outcomes. The second method Js the 
observation and analysis of teacher practice in the attempt to relate 
skill components to student ou tcomes. The third n^ethod would utilize 
the judgments of teacher-practitioners and other knowledgeable obser- " 
vers as to the skills Important in teaching. Hopefully, the results 
from these three methods would converge toward sound knowledge on the 
operation of teaching skills a,nd their effects on desired outcomes. 

Program 4.1.1: Employ a Conceptual -Analytic Method for Identifying 
Hypotheses about Effective Skills . ~ " 7 

Learning occurs within a context that represents the intersection 
of theory, curriculum, , and school organization. Whether explicitly 
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stated or. not, one of* more theoretical foundations underlie the content 
presented to the learner and the manner In which this presentation is 
made. Cur ricular frameworks further refine the content and metho,ds of 
instrucITon. When viewed in concert with theory, this refinement may 
or may not be complejnentary. School o rganization likewise^ infltfences 
the mode and style of teaching and learning. TRi" conceptual -analytic 
method of identifying skills can start with any of theive -three sources 
to generate conceptions of instr^uctional roles, and of the teacher 
behaviors and skills associated with\l earner outcomes; 

These thre'e sources are not completely independent and may inter- 
act with or influence one another, Cons.equeptly, the' sources may be 
employed separately or in combinatjofi ^to specify an instructional role 
and generate -descfiptions of sklVfs. 'Exhibit iy-4hows the interrela-« 
tionship of ^ these three, sources.' ^ 



^Teacher Skills Intersect 



Educationally 
Relevant 
Theory • ^ 




5chool 

Organization 
Design 



EXHIBIT IV 



Curriculum 
Design 

The Intersection of Teacher Skills with 
Organization, Curriculum and Theory. 



" ^Educational Theory as a Source . The operational ization of a 
theory or set of theories constitutes the development. of a model of 
teaching (See Models of Teaching by Joyce and Weil ,.1972). A model 
of teaching is the specification of a learning Environment in* terms. of 
the teaching skills necessary to initiate It, maintain it, and modifj^ 
it 'for 1 earners. ' . , - , 

.Theory can be used as the .major source of an Instructional model. 
In a few cases,> it has even been applied to the creation of the instruc- 
tional roles for an entire school plan. An example Is the extrapolation 
from John Dewey's theories* (19l6)"to^ the models for the early Dewey 
schools. More often, theory *1s used to provide the specification for 
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* ^^.^^ instructional roles prov*ided by curriculum and school design* AusubeVs 

theory of verbal learning (1963) was as^d as the design for the Georgia 
Geography Project. Counseling theories are often employed to design 
the role of counselor in a school'. 

vMany applications of theory to education have been truncated 
because the type of research envisioned in this program* has not been 
,c4rried out. The thories have not been -fully operattonalized into a 
model of teaching, a training systan relative to the skillsfof the 
mb8el has not been developfed,^ and the skills,- and hence, the model, 
hav^^not been validated with respect to pupil outcomes. • 

Projects to generate teaching skills should include the following 
elements: 

Ik 

1. Description of the theory^and its potential for generating 
' an instructional model. * - ^ 

a. The- hypothetical model -relevant outcomes* should be 
broadly indicated. .(When refined, these become 

* . the dependent' variables in the study.) ^ 

b. The anticipated broad outlines, of the instructional 
model shoujd be presented, together with needed . 
support systems, settings, etc. 

c. The rationale for the anticij)ated linkage between' 
I the model (type of teac|iing)'^and the outcomes 

should be presented, including any available empirical 
evidence and the grounding of tWe theory in a 
conceptual framework. ^ t 

d. The^ relevance of the model to curriculum and school ^ » 
organization ^S^hould be described, ,o»^ a defense 
should be made of its adequacy for generating an 
instructional role on its own terms. 

• 2, Procedures fo1^ opeRjitional izing the theory. 

a. "Scenarios" of activity developed from the theory 
. need to be developed. (For example, Taba, 1966, 

generated verbal descriptions of an "inductive" 
"modern terms of phases of cognitive "tasks.") ' 
* • 

b. The teacher behaviors necessary to activate the 
scenario need to be specified. (These represent 
the pattern of skills relevant to the model.) 

. • • ' 4^ 

' ' c. Instruments need to be developed or modified to 

assess teacher behavior. (Some' existing instruments 
are relevant to the skill demands of some theories 
but not others.) 

( 

4 
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3. Clinical feasibility studies. 

a. Procedures should be developed for generating a 
, ^ setting in which the s^:enario can be tried out. 

b. A small pilbt study should be developed. Several 
) , teachers 6r jbhq inve'stigatQf should try to carry ^ 

^ out the scenario, 'Several attempts may be necessary 

• ' ' before the theory is operational. The amount of 

time necessary for pil-ot studies 'will' vary considerably 
depending on the requirements of application of the 
' ^ theory and the adequacy of scenario. • ' ^ 

4. Identification of skills, ' . ^ *' . • 

< 

* a. Analysis of the pilot data should identify. skills 

> characteristic pf thfe model . ^ 

- — .* ^.V*'/ " T>. Hypotheses about; the relationship, of specific skifjls . 

^ • to specific outcomes should be generated. / 

^ 5. If the above steps are conducted 'successfully, the next 
step is the design of the training and validation phases, 
as set forth in Approach 4.2. 

*^ 

^ School .Organization as a Source . > Schools can be organized .inf^a « 
variety of ways and characterized by any. of a large number of theories 
of educfatlon. The combination of an organl^zation and an approach 
toward education can greatly affect the instructional demands placed 
. On any given teacher. For example, the role of a science center • 

teacher In an "inquiry-oriented" school Is quite d.ifferent from the % 
• role of a self-conta1nec^classr,oom teacher In a "traditionally-oriented" 
school . * 



The analysis of the task demands of instructipnal roles 1n-^chool§ 
can generate-hypotheses about outcome -related teac|i1ng skills. Many 
attempts to change school organization patterns or to Implement alterna- 
tive educational stances have'evidently been very difficult because 
teachers haVe' lacked the repertoire necessary for their hew roles^ 

As *1n the case of the other conceptual -analyjiic sources, studies 
proceeding from role-demands follow thr'ee phases: hypothesis-generation, 
training development, and validation. 

Projects in this area should Include the following elements:- . ' 

1. Definition of role-relevant outcomes. The assigned role Is 
defined in terms of outcome-related Instructional functions. 

•2. ^ The creation MDf prototype settings for the enac^ent of the 

role. Thesf*settings become the laboratories for the hypothesls- 
generation. process. ' ^ * ^ 
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^ 3. A process, for making a task analysis of the teaching processes 
relative to the rple. This process can be inductive, in 
which case it is accomplished by studying (describing, cate- 
gorizing, coding) th#behavior that teachers engage in as 
they enact the role in the prototype settings*. Otherwise 
conceptual analysis is used, and sources of theory and * 

^ . . curricular-instructional steps are. utilized. ' ' 

Curriculum Frameworl< as a Source . Teaching and learning do not 
occur In 'a void. Something ^must. be taught, and something must be 
learned* Generally, -this something is^ designated by tjie curricular 
framework of the*schoo.\. , These frameworks specify such dimensions as 
the subject mattef. content; the approaches to thinking and the cognitive 
reorganization anrf- restructuring to be acquirecl by the learner; *the 
means whereby the learner is to be exposed to both the coptent and the , . ^ 
.thinking processes, e.g., the learning experiences and materials to be 
used; and. the criteria by which learning of both content 'and thinking 
processes wiVl be- judged. , ' , , . 

Obviously, specification of such requirements defines much of tpe 
context in which teaching andjearning will occur and, in turn, influ- 
ences the types of teaching skills required* to support the learninq 
task. ' ' ' ^ 

. ' / ^ ^ . ^-^ - 

For example, the socieTl science curriculum created by f^iba (1966) 
designates the use of a particular form ot Inquiry learnirig; - Learners 
are to move thrbugh a planned sequence of, thinking, Analysis of this 
sequence would help identify those teaching skills that are most likely 
to support achievement. of the learning outcomes described in the curri- 
culum. The, teacher's juse^of these skills while working with the 
curriculum could thus be described in measurable terms and then studied 
by means of observation. - * * v - 

Another examp*le of the way in vyhich a curriculum fnamework influences 
the .range of teaching skills required to produce effective learnind is 
t])e "new math" introduced in the 1960*sV This^'framework^emphasizfed^ ^ 
uriderstanding^of "mathematical concepts rather than rote learning of ' 
computational skills. The teaching 'skjlls supporting' this shift iri ' 



Hypothesjs-generating projects in the curricular framework are? • 
ight be expected to move through the following steps: 

1. Identify the curricular area and the framework within that 
area to be analyzed. Generally, in order to merit analysis, 
this would be a new framework that incorporates a' number t)f 
new ways of approaching teaching and learning and inc-ludes 
new subject matter content. . ^ * 
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2. Analyze the framework in order to outline (a)' the learning 
outcomes to be achieved; (b) the learning processes to be 
used and learner skills, that are related to or are incorpo- 
rated within these processes-; (c) the instructional context . 
required for learning to occur; ,(d) the- model of teaching 

.that underlies (a), (b), and <c). 

'* 

3. Develop, a model of teaching that ^supports the curriculum.' 
This modal may include single teaching skills that are logi- 
cally related to achievement of specified learner outcomes 

* , and teaching skill repertoires, that are most likely to 

produce the desired changes in the learner. 

4. .Operational ize model by identifying despriptions of 
teaching skills "aricf learner outcomes. The descriptions 
generally would include procedures for observing. and measuring 
the occurrence of both teacher and learner behaviors. 

5. 'Conduct a small-scale pilot test of the model to-establish 

whether teachers can implement the model and to determine 
whether use of the teaching skills as described produces 
the desired learner outcomes. 

6. From an analysis of the pilot test, 'generate hypotheses 
concerning which teaching^ skills are related to which learner 
outcomes within the curricUlar framework beSng considered. 

V - The importahca of this form of teacr^ing sMr'W. identification V^s . 

-.Remonstrated during the 1960*s. In^that period mafty new curricula such 
as PSSC and BSCS were introduced without due concern for the necessary 
accompanying teaching skill requirements! The new curricula. failed to 
achieve the desired learner outcomes in those many Instances* when 
teachers did hot employ the required skills. 

Multiple Sources:_ The Intersection of Theory, Curriculum, and 
School Organization" Because of "real world" circumstances, some of 
the most critical seari:hes for descriptors of effective teaching will 
center on the intersections of theory, curriculum, and school' organi- 
zation. 

• ' ^ ^ 

Such searches have begin to take. place only recen-fly in, for- 
example, the" General Catalog of Teaching Skills (Turner, 1973) and the 
Educational Testing Servicers review of literature regarding teaching 
skills in reading and matheftfatics (1974), Few research efforts have, 
as yet, extended these skill identification activities into the experi- 
mental validation of the effects of the skills upon learner outcomes 
or the study of training needs in the skill areas. ' 

When this "intersectional approach" to identifying teachin^f. skills 
is taken, all the analytic steps and procedures outlined above for 
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each of the^' three variable bases (theory, curriculum, and school orgarVi- 
zation) must be applied. The analysis may begin with any of the three 
areas. It must first consider thg^nique contribution of eaeh area ^o 
the definition of teaching skills and learner outcomes; then determine 
whether the points of intersection expand, restrict, or modify the 
teaching skills and learning outcomes identified within the separate 
areas. From this, a single model of teaching and a single cluster of 
learning outconte's will emerge. 

For example, in 'the area of reading as decoding, the following 
paradigm might be drawn for identifying teaching skills and learning 
outcomes: 

area of psycholinguistic theory would be analyzed for 
vant learning outcomes and teaching skills. 

2. A curricular framework, e.g., the Distar Reading Program, 
might be selected and analyzed. This analysis would be 
used to refine and modify the teaching skills and learning 
outcomes extracted from the theoretical areas. 

3. An organizational system would be consl'dered; in particular, 
a system that complemented the theoretical and curricular 
area$ that had been selected for analysis. 

4. A set of learning outcomes and a model of teaching involving 
several teaching skills and skill sequences would be devel- 
oped and tested. . . . 

' Such^an analysis' procedure leads to a complex and multirdimensional 
definition of teaching skills. It is intriguing to consider the total 
possible effects. of a point of intersection in which all contributing 
areas represent a consistent and complementary definition of relevant 
teaching skills. In other words, the point of intersection represents 
a major part of the contribution from each area.^ 

An illustration of such a circumstance might be a school organized 
to provide mapy informal opportunities for learner-directed inquiry (see, 
for example, Bruner, 1966) with guidance from a curricular framework 
that incorporates anfl builds upon Piagetian theory. Here, theory, 
curriculum, and school organization are highly complementary. Teaching ' 
skills resulting from joint analysis of these areas should have a high 
potential for effecting the logically related learner outcomes. 

Cifteria for Evaluating Projects . Projects focusing on identifying 
teaching skills in the intersection of theory, curriculum, and school 
organization should be evaluated on the basis of the following criteria: 

'1. A plan for determining the applicability of the teaching 
skills to relevant learning outcomes. 
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2. A description of the data sources to be used. 

.a. A project proposal should include a matrix, or other 
form of display, outlining the dimensions of each area 
to be considered. In other words, delimit the general 
theory areas as well as the specific theories within 
each curricular area, and the specific organizational 
frameworks. . 

b. A discussion of the amount of learner variability within 
each area, as well as within the total interactive 
* region, that may be expected to be due to teaching as 
contrasted with other moderators, such as home environ- 
ment, ' 

3. A statement concerning the relevance of the analysis to the 
present and future role of the teacher. 

4. A plan to define the conception of teaching in terms of 
operations. 

a. This plan should provide a means for developing 
descriptors of the teaching skills and learning outcomes. 

b. The plan should include procedures for identifying or 
developing and testing observational and other means 
of measuring relevant teaching skills. 

5. A discussion of the bases from which hypotheses will be 
generated regarding the relationship between teaching skills 
and learning outcomes. 

6. A plan for determining (a) the tralnability of the specified 
teaching skills and (b) the need for training if the skills 
are to be studied experimentally. 

7. A presentation of the linkage of the project with future 
training projects and experimental studies of teaching. 

Illustrative Projects . In relation to the preceding discussion, 
the illustrative projects which follow are organized in accord with 
the sources discussed. The first two projects (4.1.1.1 and 4,T.1»2) 
illustrate types of projects in Class I: Theory Sources. The next 
project (4.1.1.3) illustrateo projects in Class II: School Organiza- 
tion Sources. Then Project 4.1.1.4 illustrates projects in Class III: 
Curricular Framework Sources. Finally, Project 4.1.1.5 illustrates , 
projects in Class IV: Identifying Teaching Skills Based Upon the 
Intersection of Two or more Variable Bases. 
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^ Project Examine the Influence of Pupil Characteristics on 

the Efffictiyeness of Teaching Skills Derived fron a Theory of Indu ctive 
leaching. Aptitude- treatment-interaction (ATI) research suggests that 
educational treatments should be influenced by ouoil characteristics 
Teache* skills are likely to be differentially effective, and descrio- 
tipns of effectiveness are likely to have to be expressed in terms of 
Dunil characteristics. There has been much. ATI research. Theoretical 
models have related educational procedures to ouoil class (Hunt, i960) 
Few investi nations have explored the effectiveness of specific teaching 
skills, such as those reauired in inductive teachina, in terms of puoil 
characteristics. ^ r . 



Project 4.1,1.2: Generate Hypotheses about Effective Teaching 
Skills through Operational ization of John Dewey*s Social Theory . Most 
attempts to apply democratic process theoi^y to education have run into 
severe difficulty because essental and valid teaching skills have not 
been created. Hence, systematic teacher training has not been developed. 

There is a vasf literature relative to democratic-process teaching 
theories (Dewey, 1916; Thelen, 1960^ Hullfish and Smith, 1961). A 
considerable literature utilizing social climate categories has resulted 
in a complex pattern of results vrfiich suggest great variation in teacher 
behavior but as yet, an insufficient ground for specific -hypothesis- 
generation. 

The specific objective of this project is to generate hypotheses about 
skills necessary to teacH children to carry on democratic processes (e.g., 
to negotiate group goals and procedures). To achieve this objective, the 
following plan would be carried out: (a) develop an operational scenario from 
theory sources; (b) implement the scenario in pilot settings; (c) revise the 
scenario; (d) develop instruments for recording skills present; (e) identify 
skill descriptions by applying instruments in pilot tryouts; (f) develop 
measures of pupil actjuisition of democratic prqcess skills; and (g) 
generate hypotheses about specific skills and specific pupil outcomes. 

Project 4.1.1.3: Generate Hypotheses about Teaching Skills from the 
Study"^ Teacher Adaptation to the Instructor's Role in System^ Oriented 
Instruction in Reading (e.g*, IPI, IGE) . Systems approaches to early 
reading cannot be carried out without teacher acquisition of relevant 
skills. 'The ability of teachers to transfer skills fron one roTe to 
another— as well as their ability to acquire new skills— is virtually 
unknown. 

There has been some attention to the requirements of systems approaches 
and a few training systems have been developed. The field is virtually 
barren, however, of studies of teachers* ability to adapt to systems 
approaches (e.g.. Individually Prescribed Instruction), and only a few 
validation studies exist. 

The specific objective of this project is to identify the skills 
teachers develop as they adapt tothe^role of instructional system 
facilitator and to generate hypotheses about the relationship of these 
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skills to specific learning outcomes. The plan to achieve this project 
objective Kould include; (a) selection of a comprehensive instructional 
system in a basic primary school curriculum area; (b) development of a 
setting in which the teacher can enact the role of facilitator to tha^t 
system; (c) study of the variability in teacher behavior and student 
outcomes; (d) study of the changes in teacher behavior over time and 
determination of whether these'^are assoc1a:te.d with changes in pupil out- 
' comes; (e) generation of hypotheses about teaching skills which relate 
to pupil outcomes; and (f) development of training procedures and valida- 
tion as outlined in Approach 4.2. ^ 

Project 4 J. 1.4; Develop the Concepts Related to Subject Matter 
Competence with Respect to Teaching ! There Is a need to reexamine 
subject matter competence so as to generate content learning strategies 
in the preparation of teachers. In many content areas, knowledge is 
substituted for procedures. 

Many of the studies of competency-based teacher education have 
focused on pedagogical procedures to the exclusion of procedures 
undertaken by practitioners of the fields being taught. Projects that 
have examined subject matter (e.g., ISCPET, in Purves, 1973) have 
conceptualized subject matter in terms of knowledge. * . 

The specific objective of this project is to devise a conceptualiza- 
tion of teaching practice in a content area so as to provide a basis for 
identifying teacher skills unique to that area. The plan for such a project 
should Include the >fol.l owing steps: " (a) assemble subject matter experts 
in a field togeth^ with teachers and. researchers; (b) produce a work- 
ina document outlining teaching practice as subject matter competence; 
(c; select exemplary teachers with subject matter competence for observa- 
tion and analysis; (d) reduce raw observational and analytic data to 
statements concerning subject matter competence and related pedagogical 
skills; and (e) develop training and validation processes as outlined in 
Approach 4.2. • 

*' 

Project 4.1.1.S; Identify Teaching Skills that are Logically 
Related to Advancing Learner's Level of Moral Development . Basic 
research on teaching as it affects moral development cannot be opera- 
tionally defined without^a project of this type. Relevant knowledge 
cannot be applied to the study of teaching without the completion of 
projects in this class. 

Three kinds of current knowledge in this area are particularly 
relevant; (a) theories of moral development, such as Kohlberg's (1966), 
and theories of cognitive development, particularly- from the Piagetian 
viewpoint; (b) curricula fwnphasizing moral development, such as Shaftel's 
applications of role playing to this area (1967), and (c) school 
organization based upon a social action viewpoint. 

For initial steps in ski'll identification, see the Indiana University 
General Catalogue of Teaching Skills (Turner, 1973), chapter 3, and the 
Far West Laboratory's Minicourse onT)1scussing Controversial Issues (1974). 

*The specific objective of this project is to identify and operation- 
ally define teaching skills which are logically necessary to the achieve- 
ment of moral development outcomes as defined by: (a) theoretical 
foundations relevant to education, (b) curricular frameworks, (c) school 
organization, and (d) the intersection of two or more of these elements. 
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The specific action plan would include the following steps: 
(a) complete a review of literature related to theories of moral-cogni- 
tive development, moral development curricula, and social-action school 
plans; (b) extract from the reviews a tentative set of learning outcomes 
and a logically related model of teaching; (c) define the model of teach- 
ing operationally by providing descriptions of teaching' skills; (d) define 
the learning outcomes in terms of operations; and (e) test the model to 
determine whether teacher*skills when used produce specified learner 
outcomes and whether teachers can learn and apply the models 



Program 4.1.2; Observe and Analyze Current Teacher Practice, in . 
Relation to Student Outcomes, as a Means of Identifying Skills . 

In selecting Program 4^1.2 as one of three programs under Approach 
4.1, the Panel addressed three concerhs: (a) skill identification, (b) 
characteristics of the studies to be funded, and (c) criteria for 
evaluating descriptive, observer-based studies designed to identify 
teaching skills. A brief discussion of each of these concerns follows. 

Skill identification . With learner outcomes' as a point of departure, 
this program vyould identify specific teacher behaviors that relate 
significantly to the designated learner outcomes. 

Characteristics of the Studies to be Funded . These, could be small- 
scale correlaHonaTrTEudie^^ inservice teachers 
and their students. These teachers would be observed carefully in 
their regular teaching roles to identify and specify teaching skills 
and behaviors which appear <to be related to the designated pupil 
outcomes. Pupil performance that preceded and followed the specified 
teaching behaviors would also be studied. Correlational techniques would 
be used to relate specific teacher behaviors to pupil outcomes while 
partialling out other major variables (such as learner ability) that 
might be related significantly to learner outcomes.^ 

Criteria for Evaluating Descriptive, Observer-Based Studies Designed 
to Identify Teaching Skills . These criteria do not deal with general 
\ methodological factors applicable to any research project; they can 
however, be applied vnther to single studies or clusters of related 
studies. In the latter case, the cluster of studies should be evaluated 
u^ing the criteria. These criteria also deal with continua rather than 
dichotomies. After the desirable end of the continuum is identified, 
evaluation would consider how close to this end a given study approaches. 

Ten specific criteria were identified by the Panel as particularly 
relevant to this program. First, studies in which observations are 
conducted on a wide variety of teaching situations are preferable to those 
that are limited to one situation. For example, a study that observes 
teaching in a variety of developmental levels, socio-economic levels, 
curriculum areas, and ethnic and racial groups is preferable to one 
that does not. Any stu^iy seeking to define the skills of teachers from 
the observation of teacher performance must fully define the setting of 
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that performance. Setting includes the type of school, the type of 
classroom or learning environment, the characteristics of the learners, 
and the subject matter^or skills being taught and learned. Generaliza- , 
*tions from a single setting are suspect* But at tl\p same time a researcher 
should justify the possibilities of generalization as well as the limfts 
upon such generalization. The teachers themselves should vary in back- 
ground, train^ing, experience, and orientation so that skills can be 
related to such .personal variables. Such variations .in teaching environ- 
ments and teacher characteristics increase the probability that skills 
* will emerge and give the investigator a better insight into the general 
utility of the skills he discovers. ^ 

Second, studies that propose to explore areas of teaching where 
there is a good chance of locatingskills that can be linked directly to 
learner outcomes ?re preferable to studies in whicTi the linkage seems 
. poor.. , * • 

Third, studies that look at the differences in effectiveness of 
specific teaching skills* in achieving different kinds of .instructional 
goals (such as knowledge acquisition vs. ability to manipulate ideas) 
are preferable to 'those that focus or\ a single kind of learning. 

Fourth, studies that explore why teachers use a given behavior are 
preferable to^ those which do not. 

Fifth, studies that combine two starting-point strategies are 
preferable to those that are limited to one or the other. The two 
starting-point strategies are those that (a) start v/ith pupil outcomes 
' and try to define the teaching skills that lead to these outcomes, and 
(b)^ start with an observation of teaching behavior and try to hypothe- 
size how tentatively identified skills might affect pupil outcomes. 

Sixth, studies that look at antecedent and consequent learner 
behavior^are preferable to those that look only at the teaching skills; 
i.e., observations of teaching skills are more likely to be productive 
when fitted into the context of learner behavior. 

Seventh, studies supported by a firm rationale or justification 
based upon previous research, theory, and expert judgment are 
.preferable'to studies less well supported. 

Eighth, studies that use several theoretical frames of reference to 
identify skills to be observed are preferable to studies that focus on 
a single frame of reference. 

Ninth, studies that employ more than one data collection strategy 
(e.g., direct observation vs. videotape analysis vs. typescript analysis) 
are preferable since they are less likely to yield results that are 
artifacts of the data collection system. There are a variety of recog- - 
nized schemes for the observation of teaching. Such schemes necessarily 
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determine what is observed and classified as a skill. A research project 
should allow the researcher to discover new skills or frames of reference 
as well as to employ existing frames. 

A'nd finally, studies that combine tightly controlled simulations with 
observations in naturalistic field settings and use one strategy to cross- 
check against the other are preferable to single-strategy approaches. 

II 1 us tra tive Projec ts . The Panel outlined three projects which 
a t tempt to fulfill these cr 1 1 er i a . 



Project 4.1 .2.1 Use Inductive Methods to Determine Teaching Skills 
from Observational Surveys of Teachers 1n Hlgh-and-Low-AchlevIng Schools. 
Teacher skills should be- related to agreed-upon achievement data, but 
previous research has not clearly identified teacher skills associated 
with student outcomes in high- versus low-achieving schools. In most 
studies of achievement variation between schools about 50% of the .variance 
remains unexplained. Evidence, from the Equal Educational Opportunity 
Survey (Coleman et al., 1966) especially,. suggests that a portion ofi 
this variance is attributable to differences in teacher skills between 
schools. 

The specific objective of this project Is to obtain information 
concerning teacher behaviors and skills In high and low achieving schools. 
The action plan for accomplishing tnis objective would entail: (a) using 
existing data from surveys of achievement In urban areas to, identify 
similar schools that fall far above or far below the regression line; 
(b) observing teachers and their classes In these schools;- and (c) defin- 
ing, from the observation, a list of skills for subsequent validation. 

Project 4.1.2.2: Determine Relationships Between Frame Factors and 
the Effectiveness of Teaching Skills . There 1s a need to look at the ways 
by which different Institutional and societal factors "frame" the teacher's 
actions so that "good" teaching produces desirable student outcomes In 
one frame and not 1^ another, studies have shown variations. in the 
effectiveness of teacher skills from class to class or from school to 
school (e.g., Brophy^and Evertson, 1974). The concept of frame (Dahllof, 
1971; Lundgren, 1972; Kallos, J973) might help to explain some of the 
reasons for this phenomenon. 

The specific objective of this projec^ is to delineate those frame 
factors that most exert influence on the effectiveness of teaching per- 
formance. The action plan would involve^: Ca) determining a subjective out- 
come area; (b) determining frame factors of sufficient variability; (c) 
sending teams of observers to note teachers* acts in relation to pupil 
outcomes and note specific frame factors; and (d) when successful acts in 
one frame are found, conduct an experiment to reproduce them in another 
frame to see If there are sustaining aspects of frame. 

Project 4.1.2.3: Examine and Improve the Curriculum Modification 
Skills of Teachers . Curriculum plans and projects are either adapted to 
needs of particular students or, alternatively, closely followed. Instances 
of high achievement might point either to a teacher's modification of 
curriculum strategies or to a teacher's following guidelines exactly. 



nie conference on studies in teaching 



Th^ specific objective of this projfect is, to, determine decision points, 
acts, and strategies by which tea.chers can adapt curricula to meet local 
needs. An action l^lan for achieving thi^s objective would •entail : (a) select- 
ing a curriculum and ^ites. where the curriculum has achieved success 
and sites where it has failed; (b) s'erfding a team to observe the sites to ' 
determine the ways in which the curriculum was modified; (c) after analysis, V 
sending observers into comparable sites to see whether teachers adopt simi- ^. 
lar modifications and strategies and hence, cross-validate; and (d) deter- 
mining the modii^ication acts and strategies that seem successful. . 



Program 4.1.3: Examine Needs Assessments and Other Kinds of Expert Opinion 
as a Means of Identifying Skills . ^ 

Picactiti oners, particularly teachers, and, for some purposes, students 
and parents, *are in a good position to identify and clarify needs for new 
and improved teaching skills related to educational outcomes. Their advan- 
tageous position for doing this results from: (a) the frequent agreement 
among practitioners that presiently employed skills ar^ unsuccessful in pro- ^ 
ducing desired outcomes, (b) requirements for new skills needed to bring about 
newly agreed-on outcomes, an'H fc) practitioners' hypotheses concerning par- 
ticular skills that might contribute to better achievement of outcomes. 

•* * / 

The assumptions in this program are that juries of practitioners can 
identify needs, for research and development on teaching skills and that much 
research on improving skills will be enhanced and its useful results will- be 
more fully implemented and disseminated if practitioners, researchers, and, for 
some purposes, students and parents, collaborate in the effort. In addition, 
practitioners will be more committed to the use of skills if they are 
involved In the research and development on the skills. 

Criteria for Evaluating Practitioner-Based Studies Designed to Identify 
Teaching Skills . Specific criteria for projects in this program which should 
be met includ,e: ' v . ' 

1, ,The projects should be based upon assessment of the need for 
sit;-i lis— assessment by practitioners, and, for some fiurposes, 
students and parents. 

Projects should be field-centered and aCtion-or>iented. 

The projects should be cooperatively conducted by practi/i oners 
and researchers. 

Time allowances for such studies should take into account the 
possibility that their jury-based origins will result in 
societal consequences such^ that the jury will require immediate 
feedback. " 

Studies in which observations are conducted by a jury in a wide 
variety of teaching situations are preferable to those that are 
limited to one situation and a single observer. 
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6. Projects that propose to explore areas of teaching where 
there is a good chance of identifying skills that can be 
linked directly to learner outcomes should take priority 
over studies that explore areas in which the linkage be- 
tween teaching skills and learner outcomes is complex and 
unclear. 

7. Projects that relate teaching skills both to overall learner 
outcomes^and to^diffejnent outcomes for learners with different 
characteristics are preferable to studies that incorporate 
only one of these approafches. 

8. Projects must clearly define the context in which they are to 
be conducted, including up-to-dateness of curriculum, avail-, 
ability of materials and media, manageability of teaching loads, 
time available to teach, and opportunity for maintenance of the 

"skills. 

9,. Studies must define the characteristics of teachers in order 
to relate skills to personal variables. And finally, studies 
' should employ more than one data collecting device. 

Lllustrative Projects. Two Illustrative projects (4.1.3.1 and 4.1.3.2) 
were presented by the Panel as examples of the types of projects Included 
In^Program 4.1.3. Because the projects are similar, they are combined for 
purposes of this report. 



Project 4.1.3.1: identify Teaching Skills Most Appropriate 
to Learning outcomes ln New currlcuiar Areas . 



Project 4.1.3.2: Deter min e Significance of Student Learning Outcomes anS" 
Correlated Teaching Skills as Viewed by Juries of Teachers and Parents 
According to School Settings . Practitioners and clients (parents and students) 
should be Involved in helping to identify the skills that teacfiers need for 
teaching students. There exists no reference document cataloging teaching skills 
and learn.er outcomes that the^ practitioners and parents consider important. 
Learner outcomes and teacher skills must be identified and defined by 
teachers and parents in terms of language and concepts which both groups 
can understand. 

. The specific objective oXthese projects would be to determine 
pupil outcomes and associated teaching skills identified as important 
in various settings (such as free school and inner city) by teachers 
and clients. *To achieve this objective, the action plan would involve: 
(a) obtaining teaching outcomes and hypothesized associated skills 
from juries of practitioners and client^, (b) develop a classification 
system, and (c) develop a system for validating skills irf various 
settings as per Approach 4.2. One potential barrier to completion of 
these projects is that parents may not be'v/i'lTing (or able) to address 
the needed teaching skills in detail. Teachers may also have difficulty 
specifying the skiMs they employ. 
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APPROACH 4.2 



EXAMINE ALTERNATIVE APPROACHES TO THE TRAINING- 
AND VALIDATION OF GENERAL 
AND SPECIFIC' TEACHING SKILLS 



As was discusseid earlier in the introductory section pn "Derivation 
of Approaches and Programs (Cf, pp. 5-6), this second Approach moves from 
identifying teaching skills to the use. and testing of those skills in . 
teacher training. Six programs were selected by the Panel as relevant 
areas for research and development under Approach 4.2. 

< 1' 

Program 4.2.1: [Examine Changes in the Effectiveness of Skills Caused 
by Differences in Pupil Characteristics' . 



. No standard definition exists of the behavioral units constituting 
a "skill." Also, there are no fully appropriate metrics for measuring^ 
skills. One way to^'iew this state of affairs is to .assume that a skill 
is an elastic unit of behavior, the extent or magnitude of which depends 
on what constitutes an effective stimulus for the recipient, e.g., a 
student. For example, "probing" as a startdard skill is suspected of 
beijig ineffectivel^th young disadvantapefl students; "higher order ^ 
questions" are also suspected of being ineffective for such students when 
achievemient tests are the criterion variable. One interpretation of 
the ineffectiveness of such "skilU" is that, as practiced by teachers, 
they are not' apprehended by certain students as effective stimuli even 
thpugh they may be thus seen by adults,. This interpretation implies 
that variation in the outcomes associated with particular teacher 
behaviors is predictable, is to be regarded as a function of the 
students taught, and is to be specifically regarded as a function of 
the smallest effective behavioral stimulus to which these students can 
or will respond. Similarly, the behavior constituting an effective 
skill may be highly elastic or of varying magnitudes depending on how 
many and what kinds of stimuli are needed to produce a given effect with 
particular students. The elasticity of a skill refers to its range of 
possible effective magnitudes, e.g., the possibility that a teacher 
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may withhold performance of a particular skill (reduce its magnitude to 
zero in casei where the performance of the skill would, in all likeli- 
hood, .result in noneffectivenessj.as for example, in "probing "''the' 
response. of certain types of students. Project ^.2.1. I illustrates the 
type of^ projects that would be conducted, in Program 4,2J, 

, • ■ \ 

Project 4.2.1.1: Study the Association Between Variations in Skill 
' Magnitudes and Learner Outcomes in Reading at Three Girade Levels . TRe 
prtmary target group for this class ot projects would be pupils va ry i ng 
in: Ja) age or grade, (b) socio-economic status, and (c) where pertinent, 
race. At the present time no literature exists on skill magnitude 
relative to effectiveness of stimuli. Literature on effective stimuli 
must, however, be reviewed. . . 

The specific objective of this project is 'to determine whether 
variation Jn skill magnitudes- are correlates of on-task behavior and * 
residual gain iri reading. To achieve this objective, the following 
implementation plan is suggested: Jy, , 

1. Development of an observation system* covering no less 
• than five skills varying in magnitude. 

Selection of sample schools. - 

Observation of designated classes to determine those 
that are high and low In on-task behavior. 

Selection of contrast (high on-task, low on-task) classes, . 

Administration of pre-test reading performance. 

Carrying out of In-class observation- of skill magnitudes 
and reliability check on observations. 

Administration of post-test of reading performance, and 

Application of data analysis, methodology. | 



Program 4.2.2; Determine Which Training Strategies Effectively Produce 
Acquisition of a Skill At Each Level of Skill Acquisition . 

: ^ : 

A major concern in all teacher training institutions as well as* ' 
most school systems is to have access to the most effective' strategies 
for producing specific teaching skills at each level of skill acquisi- 
tion. At least four levels of acquisition must be considered— the- 
cognitive level, the unit' acquisition level, the unit fixat'ion level, and 
the autonomous level (Fitts, 1962). 



2. 
.3. 

4. 

5; 

6. 
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The cognitive level^is defined as the conceptualization of the * 
skills or incbrporating into cognition the main features of the skill 
and its ^omponent^ parts. 

♦ * 

The unit acquisition level is defined as the acquisitipn of the 
elements, of the skill as a result of practice on the component parts 
of the skill. 

? , The unit fi)^ation level is defined as the integration of the parts 
into a correctly ordered, but not independent, operation of the skill. 

t 

The autonomous level is defined as a- completely independent opera- 
tion or mastery of the skill, i.e., the ability to perform it smoothly 
ajjd efficiently when require^. 

Finding the best techniques for training at each of the levels of 
skill acquisit'^on is the purpose of this program. Project 4.2.2.1 
illustrates the type of projects included in, Program 4-2.2. ; > 

' - - Project 4.2.2.1: Oetermine the Effectiveness of Different Training 
Procedures for Developing Different Mastery Levels 1n the Training of 
Various Types of Stdlls . Some current knowledge In this. area exists, such 
as that from: (a) work on ^Instructional media, dating from Lumsdaine*s 
early work (1963) to the present, much of it done in military settings; 
(b) Bandura and Walters' work'.on modeling (1963)'; (c) Stanford work on 
teacher training and microteaching; (d) current work on minicourses (such 
as, that by Borg et al.^ 1970); and, (e) evaluation data from the Projtocol 
Projects conducted by the Leadership Training Institute (1974) under the - 
Educational Personnel Developmertt Act (see also Borg and Stone, in press). 

' Further research in this area wouljd produce results useful in designing 
more efficient and powerful' training materials and strategies. The specific 
objective of this project is to detemine which training procedures are most 
effective in bringing trainees- up to different levels of acquisition of 
different types of teaching Skills. To achievetthis objective the project 
plan should initiate the following steps: (a) /dentify alternative training 
procedures, (b) .operationalize skill acquisition .le^jels, (c-) identify types 
of skills, (d) set up a factorial design— probably a minimum of three factors 
would be' needed, (e) deslgir^tralnlnq strategies, (f) select subj.ects so that 
there Is al mlnlmJm of about 300, (g) rajn subjects, and (h) assess effec- ' 
tlveness of training procedures for each, level of skill acquisition. 

r * * 



Program 4. 2> 3: Determine the Conditions (e.g.. Student Characteristics 
and Socio-Polltlcal Contexts) Which Maintain Teaching Skills . 

Little is to be gained from training preservice or inservice teachers 
on specific teaching skills if these skills atrophy, or become distorted 
• during .extended classroom experience. Thus, investigation of the 
conditions tHat foster skill maintenance 'and improvement in actual • 
teaching practice is needed to achieve the goal toward which Panel 4 is 
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directed/ Project 4.2.3.1 and 4.2.3.2 illustrate the types of projects 
that would *be conducted in Program 4.2.3. - ♦ ^ 



\ 



Project 4.2.3.1; Examine thg Influence-of Contextual Factors on 
Maintenance of Skills in th^Teaching of Reading and Mathematics^ Tl 



_ the 
The 



primary target group of thfs project would be urban teachers whose ^class- 
rooms are stratified by tffe socio-economic background of the students. 
The need for such a project exists because the level of perfonnance of 
teachers" varies with the appropriateness and level of support provided 
by the school. Wfiat factors in the social organization of the school, 
e.g., the amount and quality of administrative supervision, effective * 
working relations among teachers, etc., influence the development and 
maintenance of specific teaching skills? Can inservice training geared 
to skill maintenance reduce or prevent" decline in skill performance? ■ 

The s6nuence of events needed to achieve the Project objective 
should include the follov/ing: (a) develop reliable.JnstrumentS'for 
skill assessment, and (b)- select a sample of schools v/hose students 
have high' and' low residual mean^scores for^chlevement in reading. 
This analysis will produce a sample of schools hiphfy likelyj to differ . 
in the following contextual variables: (1) Socioeconomic status of the * 
students;* (ii) availability and variety of materials and *t*pher respon- 
sibility for the choice and use of the materials; (lii) stiff support 
and morale, defined in part as clegree o? informal teacher communication 
and sharina; ani^'(iv) quality of administration ]n terms of suppof^t, 
stimulation, direction, and feedback. * Select control teachers randomly 
from the high and low residcml groups of schools initially sampled which 
vary on the independent. contextual variables^being studied. Assess the. 
skill level of the teacheVs in thesej* schools bi-monthlj^ for'.ao-period 
of two years. Select experimental t*eachers randomly, again .insuring var- 
iance on the contextual variables, and us^*teachers' centers to 'maintain - 
the minimum initial skill »l^vel. The" exp6rimehtal-group teachers are 
observed bi-monthly ^ receive. sjcyi training at appropriate Intervajs. 

I^ey decisiOp points during the course tff the project would include:v 
(a)selection of schools on the tasis of residual achievement (b) estab- 
lishment of teachers' tenters and the training of teachers to initial 
skill level,, (c)> observatfons of teachers in the two sets of-schools, 
and (d) maintenance'of skills by means of the teachers* center.' 
« 

This, project 'Could have important* implications for the quality and 
^ focus of inservice teacJmr taining if thejndependent variables are ' " 
determined to be crucial to sk-ill maintenance, thus suggesting dir^^ctions 
for change Jn these school factors. If the teachers' center proves to be 
an adequate skill maintenance device, this- option in teacher training 
would supplement the changes^ involving the school factors. If the teachers' 
center proves to be an^adequate skill ^main,tenance device, this option 
in teacher training "Would supplement ^the changes involving the school 
factors. 
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Project 4.2. 3. 2f Review dnd Synthesize the Literature on Student 
Influence on Teacher Behaviors and Skills . TjiiS project should yield 
a system for* "classifying independent variables (the types of student 
behaviors influencing teachers) and the attendant dependent variables 
(teacher behaviors influenced). In addition, the project should yield 
suggestions as to. the independent v^ariables that have the greatest impact. 

The specific objective of this project would-be to synthesize the 
literature and produce a quasi-taxonon\y of studentHnfluence (independent) 
variables. To carry out the project, the sequence of events wou]d 
include the following steps: (a), identify the literature sources ^ 
(b) review the sources, (c) organize the independent variables Into 
a qOasi-taxonon\y, and (d) relate the dependent (teacher) variables to 
the independent variables by citing observed relationships and suggesting 
other probable relationships. 



Program 4>2.4; Determine the Transferability of Teaching Skills . 

The purpose of this^rogram is to examine what happens to teacher 

activities in relation to pupil outcomes vwhen the context changes. A simpl 

example is the question of what happens to the activities of a teacher 

who, having learned to .teach children reading in a "traditional" setting, 

is placed in an "open" classroom" What skills are transferable into 

the new situation in order to, effect learning? 

- i ^ 

> >> . * * 

The variables involved in studies under this heading include student 

outcomes, teacher activities, and contexts. Studies would most likely 

consist of natural experiments as well as laboratory experiments, andv 

might employ case study, as well as quasi-objective, techniques. 

The range of contextual variablesr that research projejzts might 
explore is shown in Exhibit V. A brief definition of each of the types 
of contextual variablej follows: * / ' 

^ Student . A teacher^ might find himself or herself c/onfronted by 
^different mixtures of students classified by age, /^ex, ethno-' 

al group, socio-economic status, intellectual-developmental 
or attitudes toward school, life, themselyes, and others. 

Institution . Teachers might jnpve to different Schools or live 
through changes in school size, organization (e.g., graded or 
nongraded), atmosphere or ambience, types of (Colleagues, physical 
format (e.g., fixed seat or "open"), presence^'^or strength of ' 
teachers' organizations, administrative orgajiization and decision 
making, or policy bases (e.g., change in school board). 
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Community. Teachers might move to different geographical ar'eas ' 
(^•g, , different as to whether* they are urban, suburban, or ruKal " 
f settings within a region), to schools whose clients come from 
socio-economic groups other than those to which the teachers are 
accustomed, or to schools in communities that use different lan- 
guages or dialects. 

Curriculum . A teacher might be confronted with changes in curricu- 
lum content or teaching procedure (e.g., from controlled-inductive ^ 
to free-inductive modes of teaching social science), or in materials 
(e.g., from natural science taught with books and charts to natural 
science taught with live flora and fauna). 

Projects 4.2.4.1 and 4.2.4.2 illustrate the type of projects to be 
considered in Program 4.2.4. 



Project 4.2.4.1: Examine the Changes Teachers Make When'Operating 
Under Different Curricular Assumptions .' Information is needed on. the 
changes teachers must make to adapt effectively to new assumptions about 
the curriculum. At present there is some information in studies of 
curriculum reform and change, but much of this information is embedded 
in evaluations of curriculum. (See also Chin and Downey in the Second 
Handbook on- Research in Tea c hing , 1973. ) 

The specific objective of this project woiild be to determine what 
adaptations of successful teaching have to be made when assumptions ' 
about the curriculum e.re changed. To achieve this objective the follow- 
ing action plan is suggested. First, identify sites where teachers 
have successfully taught a subject (e.g., writing) un^ler one set of 
assumptions but have decided that another set of assumptions is pref- 
erable. Second, observe te^acher behavior under both sets of assump- 
tfwis. Third, assess results of instruction. Fourth, do a correla- 
tional "Study to determine the relationship between teacher behavior 
and student achievement under the two sets of assumptions. And finally, 
experiment with behavioral changes in the light of the results of the 
correlational study. 

\ 

\^ 

Project 4.2.4.2: Develop the Means 4:o Improve Transfer of Hypothe- 
sized Generic Skills Within an Instructional Approach (Model) Across \ 
Subject Matter Areas . The primary target population for this pro- 
Ject consists of elementary school teachers teaching more than 
one subject. It may also apply to secondary teachers where 
more than one subject is taught. Projects inXhis class are intended 
to determine: (a) whether or not models of instruction transfer across 
subjects and (b) whether skills within teaching functions s^ec^ifically 
transfer. - ^ 

Current knowledge existing in this area includes B.'*Joyc^ and 
M. Weil, Models of Teaching , 1972; J. Henderson, How Should You Teach 
to be Effective ?, 1973; and R. Turner (Ed.), General Catalog of Teaching 
Skills ; 1973. - ' 

Experience indicates that different models of teaching can 'be opera- 
tional ized within subject areas. The transferability of the models and 
the skills entailed in them across subject areas* is the issue addressed. 
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The specific objective for this project is to test the transferability 
of the teacher's pupil -assessment skills, goal-setting skills, instructional- 
strategy skills, and achievement-evaluation skills across subject areas. 

To carry out this objective, it is anticipated that the sequence of 
steps would include the following: 

1. Train preservice teachers in an experimental group on four 
sets of four skills each to at least the 5nit fixation level 
of skiVl acquisition in teaching reading; one control group 
would not be trained by the instructional system and a second 
control group would be trained in mathematics but not readino 

2. -Develop the resources for an instructional unit in reading at 

each of three primary grade levels. 

3; Obtain primary school classrooms for replicating the unit 
-instruction 15 times within grade levels (may be done during 
student teaching). 

4. Randomly assign the trainees to classes within grade levels. 

5. Give reading pretests to the students of all three groups of teachers. 

6. Have one-i:hird of the trainees conduct the instructional 
unit in reading. 

7. Post-test the students of teachers in all three groups. 

8. Holding classroom constant, assign the trainees a unit of 

. Instruction in mathematics for which resources are provided. 

9. Pretest the students in the unit of mathematics instruction. 
10. Have the trainees teach the mathematics unit. 

n. Post-test the students in the unit of mathematic§^instruction. 

12. Use analysis of co-variance in the following tt^nsfer design, 
stratified by grade. * / 



Group of Teachers By 
Training Received 


Unit of Instruction 
Carried Out 




Reading 


Mathematics 


Reading Training 
Experimental Group 


X 


X 


Mathematics Training 
Control Group 




X 


No Tt*aining Control 
Group 


X 


X 
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Program 4,2,5; Examine the Validity of Teaching Skills-As-Trained . 

While this program was not developed in any detail by the Panel, major 
methodological problems were recognized in validating skills-as-trained, » 
in finding alternative training procedures to circumvent these problems, 
and in attempting to increase the effects of (variance attributed to) 
teacher skills. Project 4.2.5.1 illustrates the types of projects in- 
cluded in Program 4.2.5. 



Project 4^.2.5.1: Exanine Continuous Feedback from Students on a 
Single Teacher Behavior Variable as a Means of Changing Instructor 
Behavior and Student Outcomes . This illustrative project is essentially 
an alternative to the more conventional training studies carried out in 
Approach 4.2. This type of project, may, however, open up a "new skills- 
shaping strategy that could be much |ess costly than developing and • 
field testing elaborate training materials. In terms of current knowl- 
edge in this area, some of Bandura and Walters* work (1963) might be 
relevant. Semmel at Indiana is doing related work on feedback of teacher- 
student interaction data (personal communication, 1974). Most feedback 
research would be related. Pilot work oh the feedback display board 
has been done. at Utah State University (Borg apd Stone, In press). 

The specific objective of this illustrative project is to determine 
whether immediate feedback from students on some aspect of the teacher's 
performance^ will lepd to changes in teacher behavior and related learner 
outcomes. 

V 

In terms of availability of skill and faci-lity resources, only the 
pilot studies at Utah State University are closely related as far as is 
known. & 

The action plan for conducting such a project should include the 
following sequence of ^events: (a) develop the feedback display board 
(a prototype is now in, use), (b) select specific areas of teacher behavior 
in which feedback will be given, (c) during specified lessons, collect 
baseline data on teaching performance and learner outcomes, (d) Intro- 
duce continuous feedback display and observe Instructor behavior, 
(e) measure relevant learner outcomes, (f) repeat second through fi?th 
steps for different kinds of feedback, and (g) analyze results. 



Program 4.2.6; Examine the Teacher's Repertoire of Skills, Including 
Its Scope, Organization, Effects on Student Outcomes, and Relations 
to Teacher Characteristics . 

Effective teaching may be defined along numerous dimensions ranging 
from the total Gestalt evidenced by a teacher to a quantitative measure 
of a specific behavior, such as how many times in a 15-minute period 
the teacher provides positive reinforcement to learners. Between these 
two points on a continuum are innumerable ways to delineate the teaching act. 
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Among them are the following: 

First, combinations of two or more teaching sjcills that can be logic- 
ally^ combined and that, as a result of this combination, appear to have an 
increased potential for affecting learner performance. For example: the 
combination of proportions of higher-cognitive-level questions, probing, 
prompting, and redirection into a "repertoire unit" to be studied in toto . 

Second, profiles of behaviors as used in response to learner input. ' 
This view of teaching skill, which builds upon Nuthall and Lawrence's 
work (1965), considers qualitative measures of appropriateness of the 
behaviors used as well as quantification of those behaviors. Teaching 
behavior Is therefore studied only in relation to the learner behavior 
that precedes It. The repertoire unit Is defined as the set of teaching 
behaviors that may appropriately and effectively follow various types ^ 
of Jearner acts* ^ * 

Third, a sequence of teaching behaviors (in this instance one might 
think of them as instructional moves) required to achieve a specified 
learning (e.g., the skills sequence in Taba's teaching model, 1966). 

Research on the effects of repertoires of teaching skills upon 
learning outcomes needs to proceed simultaneously along at least two 
lines: (a) to identify significant repertoire units, and (b) to. validate 
those units that can presently be described and operational ized. 

Inasmuch as identification of significant repertqire units may be 
considered a task for Approach 4.1, the programs suggested in that Ap- 
proach should be applied to this program. It appears, however, that this 
particular research need will be served best by combining in a single 
effort at least two of the programs suggested In 4.1, e.g., a research 
project that incorporates both conceptual-analytic and natural vari- 
ability procedures. In this way, logical units can be considered at 
the same time the feasibility of their use In the "real world" is tested. 

Once a repertoire unit has been defined, experimental studies may be 
proposed to delimit the critical elements of the unit by manipulating 
the presence and form of use of the elements. Secondary analyses of 
previous studies of teaching cen also be conducted. In these analyses, 
various repertoire units may be generated from ex^isting data. Reanalysis 
then may be carried out to determine whether this new skill unit produces 
new and significant information. 

Criteria for Evaluating Projects , The following four criteria are 
suggested for judging projects In this program: 

First, the clarity and relevance of the procedures proposed for 
identifying and measuring the repertoire unit. If this is to be done through 
experimental research, the operational definition of the unit is critical. 
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The means for making the unit observable and measurable must be explicated 
in the project proposed. The relation of these units to proposed learner 
outcomes should be discussed. 

* 

If the. research strategy is based upon secondary analysis, the pro- 
posal should indicate what new repertoire units will be studied, how 
these will be derived from th^ existing data, and how they relate to the 
learning outcome included in the original study. 

Second, the appropriateness of the research methods to be employed 
in manipulating and studying teacher use of the repertoire unit. 

Third, the relevance to common educational practice of the treatment 
conditions (instructional setting), in which the unit will be studied. 

Fourth, the extent to which the research plan will provide infor- 
mation regarding the trainability of the repertoire unit (if It is proven 
effective). 

Illustrative Projects , Projects 4.2.6.1 and 4.2.6.2 itlustrate the 
types of projects included in Program 4.2.6. 



Project 4.2.6.1: Determine the Effects on Learning Outcomes of a 
Teaching Strategy Combining Hiqhet-Cognitive-Level Questioning, Prompting , 
Probing, and Redirection . Research on clusters of skills. is Important as 
the effects of teaching skills may be lost if too small a sample of teach- 
ing is used. This project provides a means of determining the most signi- 
ficant measure of teaching in an important skill area — teacher ques- 
tioning. Considerable research exists regarding the proportion of teachers* 
questions which fall in factual categories as against higher-cognitive-level 
categories. Limited research has been done'to study the effects upon 
learning of variations in teacher performance of this skill. 

Theoretical discussions of teaching suggest that prompting, probing, 
and redirection are teaching skills that encourage higher-cognitive-level 
responses by learners. See the reviews of research on questioning by 
Dunkin and Biddle (1974) and Brophy (1973). 

The specific objective of this project is to determ^ine effects upon 
learning outcomes of teacher use of higher cognitive questions without 
the support of follow-up teaching skills and with these supporting skills. 

The specific action plan would, include: (a) developing and testing 
a semi-programmed instructional unit that controls both the proportion of 
higher-cognitive-level questions to be^ asked by teachers, and teacher use 
of the supporting skills of prompting, probing, and redirection; (b) 
developing measures for relevant learner outcomes; and (c) designing ex- 
periments on the effects of different proportions of higher-cognitive- 
level questions and the presence or absence of supporting teaching skills. 
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Project 4.2.6.2; Examine the Effect of Teaching Skills Repertoire 
Organization and Sequence on Outcomes in Pupil Achievement and Attitudes . 

Most studies that have examined effects of teaching skill (s) on pupil 
outcomes look at very small, discrete units or sets of skills. Most of 
these ^studies have failed to demonstrate empirically that the skills in 
question have an appreciable effect on students. The small units and 
restricted nature of the skills examined may have causecf the lack of 
effects. Thus, there Is a need for studies that examine the potential 
effects of broad sets of skills that are linked together Into axoncep- 
tual whole. • 

The specific objective of this project Is to test simultaneously the 
effects of: (a) sets of teaching skills, and (b) repertoire organization, 
sequence, and application at s'elected times. To conduct this project, 
five sets of teachers will be trained to utilize superordlnate skills as 
they teach an Instructional unit of two weeks' duration. Four clusters 
of subordinate skills will be tested (as shown In the chart below). Thus, 
one set of teachers will be trained to utilize all four clusters, whereas 
the other four treatments will each lack one of the clusters. The inde- 
pendent variable is the presence-absence of any superordlnate cluster of 
teaching skills and the dependent variable is pupil outcomes in reading.*^ 
Concomitantly, to determine the effects of subordinate skills ^within the 
superordlnate clusters, observers will describe the presence-absence of 
subordinate skills within clusters. The steps involved are to: (a) 
develop reliable instruments that measure the presence-absence of desired 
pupil and teacher behaviors, (b) train teachers to criterion levels in 
their separate treatments to which the teachers will be randomly assigned, 
(c) train observers and check for their reliability, and (d) observe 
and describe teacher behavior and pupil outcomes. 



Treatment 


Subordinate Clusters 


1 


2-3-4 






2 


1-2-3 


3 


^ 1-2-4 


. 4 


1-3-4 



^1-2-3-4 
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SUMMARY 



Panel 4 was concerned with research aimed at the improving the 
ability and tendency of teachers to perform the skills conducive to student 
achievement of educational objectives* Two Approaches were identified: 
the identification of important skills and the training and validation 
procedures that would demonstrate the relationship of the skills to-edu- 
cational outcomes. 

The Approach concerned with the identification of teaching skills 
was formulated in terms of three programs, each oriented toward a different 
way of identifying such skills. The first of thes^e would use theoretical, 
statements drawn, from psychology, human development, pedagogy, and theories 
^of subject-matter instruction. These statements would be reduced to oper- 
ational definitions of clusters of skills, which would then be identified 
empirically in teacher behavior. This approach to skil] definition is open 
in the sense that it permits introducing new sets of skills as new ways of 
viewing education emerge. The second method to be used for identifying 
skills would depend on observing and analyzing current teacher practice. 
The practice would be 'jnalyzed into skill components. Then an attempt 
would be made to determine empirically the relationships of these com- 
ponents to educational outcomes. This method would be Jntended to reveal 
The significant skills in curt'ent teaching practices. The third method 
for identifying skills would proceed by soliciting the reports of teachers 
and other persons concerning what they consider to be important teaching 
skills. This method would identif/'skills believed to be important in 
the practice of teaching* In general, these methods do not ^^tand alone*. 
They should be seen as complementary and should be made to converge upon 
a common. set of highly salient skills. * v * / 



The second Approach, concerned with training for and validating 
teacher skills— was aimed at determining the transferability of skills 
as the circumstances surrounding teaching change. Further, it ^^as aimed 
at identifying the school conditions needed to maintain important teach- 
ing'skills at an effective level and prevent teachers from slipping into 
bad practice. Certain theoretical problems were also identified as 
intrinsic to this line of research. One of these problems is that of 
identifying metrics by which the elasticity or variability in the effec- 
tiveness of teaching skrf-lls could be defined. The second problem is 
that of Identifying the scope and nature of the repertoire of sHills 
possessed by individufil teachers and relating this repertoire, as a set. 




to educational outcomes. 
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The Panel identified speci.fic programs of research and development 
related to. each Approach. Each program includes descriptions of the 
criteria for judging the relevance of research projects within the pro- 
gram. Brief descriptions of illustrative projects are^ftrovided to 
clarify the Panel's statements about the program. The projects should 
riot -be regarded as more than examples of a class of projects to be 
developed within a given program. 
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